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ABSTRACT 

This report considers a university faculty which is 
divided into k grades. .The total size is to remain fixed, hut the 
proportions in the grades may vary. -The problem is to find control 
strategies which will bring about desired changes in these 
proportions. , This report is confined to investigating what can be 
achieved by controlling the numbers of new appointments made into 
each grade. -It is assumed that movements within the system and to the 
outside would be governed by time-homogeneous transition 
probabilities. A number of theorems are presented showing that not 
all structures can be attained and that some which are attainable 
cannot be maintained. . Some bounds are given for the length of tinie 
needed to, achieve the goal when this is possible. A nuiqber of 
suboptimal strategies are proposed and their performance is studied 
empirically, suggestions. are made for further research. Finally, a 
nontechnical summary of this analysis is given at the lieglnning of 
this report. . (Author) 
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PREFACE 

This is one of a continuing series of reports of the Ford Foundation 
sponsored Research Program in University Administration at the University 
Df California, Berkeley. The guiding purpose of this program is to under- 
take quantitative research which will assist university administrators and 
other individuals seriously- -concerned with the management of university 
systems both to understand the basic functions of their complex systems 
and to utilize effectively the tools of modem management in the allocation 
of educational resources. 

This paper presents a Markov model of a graded faculty system and in** 
vestigates preferred policies for achieving' a desired balance between 
faculty of various ranks* The problems associated with faculty promotion 
and other attrition are a complex confluence of many political, social, 
economic, and traditional forces which are greatly abstracted for the de- 
scriptive purposes of this model. 

The research reported in the Paper is not a complete analysis of the 
vital problem of faculty retention and advancement. However, this is an 
illustration of the conceptual and computational feasibility of applying 
sophisticated operations research techniques to important aspects of 
university management. 
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ABSTRACT 



This report considers a university faculty which Is divided into k 
grades. The total size is to remain fixed but the proportions in the 
grades nay vary. The problem is to find control strategies which will 
bring about desired changes In these proportions. This report is confine 
to investigating what can be achieved l5y controlling the numbers of new 
appointments made into each grade. It is assumed that movements within 
the system and to the outside would be governed by time homogeneous tran- 
sition probabilities. A number of theorems are presente<f showing that 
not all structures can be attained and that some which are attainable can- 
not be maintained. Some bounds are given for the length of time 
needed to achieve the goal when this is possible. A number of sub«^ptimal 
strategies are proposed and their performance Is studied empirically. 
Suggestions are made for further research. Finally, a nontechnical 
summary of this analysis Is given at the beginning of this report. 
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I- SUMMARY OBSERVATIONS 



1- Introduction 

The problem addressed by this report is that of naintaining a 
satisfactoi"^ balance between the numbers of faculty in the various grades 
in an institution of higher education. It has been found, for example, in 
the College of Engineering at Berkeley, that if present promotion and 
attrition rates are continued into the future- then an unduly top-heavy 
structure will result. This has been a conclusion reached in many man- 
power systems and it commonly results from a history of expansion. The 
relatively high promotion rates which were necessary and desirable during 
a period of expansion are found to be too large to maintain a satis- 
factory and stable structure once the expansion has ceased. Th^ manage- 
ment problem which this situation poses is how to maintain the required 
balance between the grades and, at the same time, maintain adequate pro- 
motion prospects to attract and retain high quality staff. 

There are three main aspects of the system which are amenable to 
control as follows: 

(a) The promotion and demotion policies. 

(b) The losses due to resignation (through depressed salary scales, 
early retirement benefits, etc.) 

(c) The proportions recruited into each grade. 

Of these the last involves the least disruption of the system and is 
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thus an obvious candidate for initial investigation. The work re- 
ported here is thus concerned with showing what changes in structure 
can be produced by making changes in the appointment pattern. All 
other parameters of the system are assumed to be constant. 

2. Attainability and Maintainability 

A principal conclusion, with important practical implications, is that 
not every desired structure can be attained. Furthermore, there are some 
structures which, though they can be attained, cannot be maintained. 
A good deal of effort has been devoted to trying to characterize these 
structures and answers have been found to some of the most important 
questions. For example, a set structures has been found which cannot 
be reached no matter where we start. Another set can be reached from 
any starting point, and there are yet others which can only be reached 
from some starting points but not others. 

3. Optimal Strategies 

If a desired structure can be attained, it is necessary to know what 
appointment" strategy should be used. This analysis shows that there is 
usually a choice of strategies and this raises the question of whether 
some are better than others. The main criterion of optimality adopted 
in this report is that of the number of steps (years in the academic 
- context-)- needed to reach the goal. In general, it does not seem 

possible to find the minimum number of steps needed but some useful re- 
sults have been found which enable a lower bound to be calculated. In 
certain cases.it is possible to find an upper bound as well. 

4. Sub-Optimal Strategies . 

In the absence of a general method of finding optimal strategies, 
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it seemed advisable to find ways of achieving more limited objectives. 
The first class investigated consisted of those which aim to get 
as near as possible to the goal at each step. There is no single measure 
of "distance" so a class of distance measures was investigated, each 
member leading to a different strategy. The performance of these 
strategies was investigated by making calculations for a three-grade 
and a five-grade organization. The tentative conclusions to be drawn 
from these calculations are as follows: 

(a) The definition of what is meant by "distance" is not crucial. 
All the strategies considered produce very similar results. 

(b) All of the strategies lead to points which can be maintained. 
If the goal is not maintainable we shall have to be satisfied 
with a nearby maintainable structure. 

(c) The more grades in the system the longer it takes to reach 
the goal. 

(d) The rate of approach to the goal is very dependent on the 
size of the loss rates. The higher the loss rate the eas- 
ier it is to effect changes in the structure. 

In order to give an idea of what is involved in implementing the 
strategies which have been discussed, a verbal description of one of 
the most successful is given. The Study first computes how many of the 
existing members of the system will still be present in one year*s 
time and how they will be distributed throughout the system. Next, 
it calculates the difference between the number desired in each grade 
and the number who will be left. In general, some of these differences 
will be positive and some negative. The positive differences are 
called the "recruitment needs" for those grades. The final stage is to 
distribute the new entrants to those grades with recruitment needs in 
proportion to those needs. 

Better strategies, which look farther ahead, have been proposed but 
not investigated in detail. 
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5. Further Work 

The work carried out so far is incomplete at almost every point. 
Some of the topics in which further work is needed are listed below. 

(a) This study assumes that the faculty size is constant in time. 
The theory should be extended to cover organizations whose 
size changes over time. 

(b) It is not known whether or not the strategies which look one 
step ahead are near to the optimum. A first step toward the 
elucidation of this point would be a comparison with those 
which look two steps ahead. 

(c) Some structures are not maintainable but it may be possiiile 
to remain near to them for a sufficiently long time. This 
point needs investigation. 

(d) The calculations in this report are based on typical but arti- 
ficial data. Suitable data collected from various colleges 
and campuses should be used to test the methods in practice. 

6. Implications for Policy 

The work described in the report is a step toward a general theory 
of control for Markov chain models of graded manpower systems. As such, it is 
primarily a theoretical exercise intended to give some insight into the dynamics 
of such systems. It was motivated by the problem facing a university whose 
faculty structure was moving in an unwanted direction and there are several 
conclusions which can be drawn which have important implications for those 
faced with that problem. For any organization in which the assumptions of the 
model apply, the following conclusions hold: 

(a) Not all structures are attainable or maintainable by control- 
ling the appointment policy alone. Those which are can be 
found from results given in the report. Those which are not 
can only be reached by making changes in the promotion rates 

or by contriving to alter the leaving rate. The kind of changes 
needed can also be determined from the results given. 

(b) Some changes in structure can be brought about by appropriate 
variations in the appointment policy. The best way to do this 
is still an open question but several strategies have been 
proposed which seem to give satisfactory results. 
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II. MATHEMATICAL ANALYSIS 
1. Statement of the Problem 

The management of a graded manpower system such as a university 
faculty involves making repeated decisions on appointments and promttlons. 
This paper is primarily concerned with hr , col the "shape" of the 

hierarchy by manipulating the pattern of appointments. 

The problem may present itself to the management of the system in 
a variety of ways. Perhaps the commonest arises when a period of expansion 
comes to an end. It is then discovered that if past promotion rates are 
continued in the future, uhe system will show unacceptable growth at the 
top. This phenomenon has been observed repeatedly In many kinds of organi- 
zations. At Berkeley,. Branchf lower 's calculations for the College of 
Engineering • the same tendency. The management problerr* which then has 
to be faced is what changes to make to bring the system under control. A 
second situation is where one wishes to prepare in advance to cope with some 
change in the external environment. For example, if ^ rew campus were to be 
established which would be expected to attract senior faculty from an 
existing campus, then the latter would wish to ensure in advance that 
sufficient people were available who were capable of being promoted to fill 
the gaps. In both examples, the problem may be stated as follows. At the 
present, we have a system with a certain grade structure. At time T in the 
future, we require it to have Some other structure. What appointment and/or 
recruitment policy should we adopt between now and T to ensure that the 
goal is achieved? 



The main parameters of the system which we subject to management 

control are the following: 

(a) The numbers of people recruited into each grade at each 

point in time. 

(b) The numbers of people promoted (or demoted) between grades 
of the system. 

(c) The numbers of people dismissed or induced to leave 
the system. 

In most organizations there is no control over members who decide to leave 
of their own free will. Control by (a) alone has many attractions. Chief 
among these is that it has fewer adverse repercussions on those who are 
already in the system than the other two methods. To control unwanted 
growth at the top by method (b) involves cutting promotion rates; method 
(c) is usually reserved for use when all else has failed'. It is for these 
reaso..3 that our main effort will be directed to (a) as a means of control. 
We shall show that it is a fundamental control variable but that there are 
severe limitations on what can be achieved by using it. This will. lead us 
to consider how methods (a) and (b) can be combined to arrive at our objec- 
tives. We shall- not discuss mechod (O . If this is available, our problem 
is trivial since a combination of (a) and (c) can always be found to 
achieve any goal as soon as devUred. 

2. The Model 

T6 analyze the problem as stated above, a mathematical model of 
the system is constructed. We shall use the Markov chain model first intro- 
duced by Gani [l963] and Young [i96l] for use in industrial and educational 
organizations. These models have been used successfully on mny occasions and 
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they Include all the basic factures required to describe a university 
faculty system. Although the Markov chain model is a stochastic model we 
shall treat it deterministically in this paper. The elements of the model 
are as follows. We have a system consisting of k grades. At time 
zero there are N members of the system of which a proportion x^(0) 
are in grade i . Changes take place at discrete points in time (yearly 
in a faculty system). The porportion who move from grade i to grade j 
at any time is denoted by p^^ and the porportion who leave is w^ ; p^^ 
is the proportion who remain in the same grade. It follows at once that 



j=l ^ij + = 1 for i = 1, 2, . . 



For simplicity we shall assume that the system is maintained at e 
constant size N by recruiting as many new members at any time as 
there are leavers. We shall let p^(T) denote the proportion of new 
recruits at time T who go into grade i . Finally, let x^(T) denote 
the proportion of the N members of the system who are in grade i at 
time T . Then tl.ere is a simple recurrence formula connecting x^(T+l) 
and x^(T) which may be expressed in matrix notation as follows; 

x(T+l) = x(T) P + x(T)w'p(T+l) (1) 



where 
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x(T) = (x.(T), X2(T), . . . Xj^(T)) 
w = (wj^, w^, . . . Wj^) 

p(T+l) = (p^(T+l), P2(T+1), . . . Pi^(T+l)) 

P11P12 • • • Plk 



P " 



P21P22 • • • P2k 



LPklPk2 • • • PkU 



It is important to note that (1) can also be written in the form 



x(T+l) = x(T)(P + w'p(T+l)) = x(T)Q(T+l) 



(2) 



where Q(T+1) is a stochastic matrix. 

The elements of P and w could be made functions of T but this would 
only be appropriate if we wished to treat them as control parameters. We 
will assume that they are fixed at their current values and see. what can be 
achieved by exercising control over p(T+l) only. Our problem may now be 
stated moje precisely as follows. 

To find a sequence of vectors p(T+l) such that we pass from the 
initial structure x(0) to the goal structure x* , say, in an "acceptable" 
way. We deliberately leave open what ,is meant by "acceptable". (I am not 
aware of any other work on this problem.) The problem of a stationary 
p , rather than P(T) , was discussed in Bartholomew, [1967]. The results 
given there have since bean extended by A. F. Forbes in a paper to be 
published* 

The elements of the vectors x(T) must all be positive and sum to one. 
It is convenient for purposes of exposition to visualize what is happening in 
geometrical terms* The structure at time T may be represented by a point 



in k-dimensional Euclidean space. It will lie in the positive orthant 
on the hyperplane x^^ + X2 + . . . x^^ = 1 . In three dimensions this 
region is an equilateral triangle in the positive octant. This represen- 
tation leads us to speak of moving from the point x(0) to the point x* 
and to refer to the path or trajectory of the movement. 

3. Two Basic Questions About x* 

The foregoing discussion should not be taken to imply that the 
problem we have set ourselves is always soluble. Before attempting to 
find optimum sequences {p(T)} we shall first attempt to discover when 
and whether a solution is possible. We consider this question in two 
parts: 

(a) Is X* attainable? 

(b) Is it maintainable? That is can wr remain at x* once we 
have arrived there? 

For practical purposes these questions are unnecessarily restrictive; 
it will usually suffice to answer 

(a*) Can we get near enough to x* ? 

(b*) Can we remain near enough to x* for a sufficiently long 
period of time? 

The second two questions are less easy to answer so we shall concentrate 
on the former but bear the latter in mind. 

4. Condition for Attainability 

We shall show that some points cannot be reached at all. Hence 
if X* belongs to this set our goal is certainly unattainable. Some 
other points are reachable from some but not all points. Finally, there 
are points which can be reached (or, at least, approached arbitrarily closely) 
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from any other point. 

We first delineate the set of points which cannot be reached no 
matter where we start. We do this by determining Its complement which 
we denote by A . The result is contalned.in the following theorem, 

THEOREM 1 

A = {x I X >_ y P X, y e X} 
where X = {x I x > 0, xl'= l} 

Proof 

If X* can be reached at all it must be reachable from at least 
■ one other point in X . That is there must be a y such that 

X* = y(P + w'p) . 

for any such point x* > yP since J^'p > 0 . A is thus the set of 
X* 's for which at least one such y can be found. 1 I 

Although this theorem characterizes A it does not make it very easy 
to determine the boundaries of the set in any particular case. Theorem 
2 is more explicit on this point. 

THEOREM 2 



A is the convex hull of the points with c o-ordinates 

P^^^ + w^e^ (j * 1, 2, ... k; i = 1, > • 

,th 



where P^^^ is the vector of elements in th e i row of P and e^ 
is a vector of zeros with a 1 in the j position. 

Proof 

Consider first the set of points which can be reached in one step 
from e^ (i « 1. 2, . . . k) . Clearly, all of these belong to A. 
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The k sets reachable from each e^ will be termed primary regions. 
Substituting T = 0, x(T) = e^ in (2) 



x(l) » e^P + e^w'p(l) (3) 
k 

'ijil Pj^^>!j 



= P^^^ + w,,Z, p.(l)e, . (4) 



The primary region is thus 

{x I X = P^^^ + w, ,i:,a.e, , Za. = 1 a > 0 , 1 = 1, 2, . . . k} . 

~ ~ ~ i j«l j~j J J j - 

Consider next the set of points which can be reached from (y^^, y2» • • • Vy) 

k 

These co-ordinates may be written ^E, y.e. 

1=1 i~i 

Substituting this for x(l) in (3) now gives 

k k 
x(l) « ^Z^ y.e^P + ^l^ yi!iW'P(l) 

k , . k k 

= 1^1 ^i! ^ ih ^1^1 ih 

k k 

■i^iyi^!-'^ +"i jSiPj<^>?j^ 



Hence, the set of points which can be reached from y Is 
^ U i X » y^{P^^^ + a^e}, > 0. la^ » 1, y > 0, Zy^ - i; 



But any point in this set is a convex combination of points in the primary 
region. Hence, the totality of points in A is the convex hull of the 
vertices of the primary region* These vertices are obtained by setting 
a » in (4) for each value of i . This gives the set of points 
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+ w^e^ (i, j = 1» 2, . . . k). 



The number of points here is * ^ and not all of them will be extreme 
points of the convex hull. However, fov k small it is a simple mat- 
ter to determine the region. 

EXAMPLE 1 

Consider a 3-grade system with the following parameters 



/ 



P = 



0.5 0.4 0 
0 0.6 0.3 
0 0 0.8 



\ 



w = (0.1, 0.1, 0.2) 



Theorem 2 says that the region A ^will be the convex hull of the points with 
co-ordinates 

(.5 + .1, .4, 0)*, (0 + .1. .6, .3), (0 + .2, 0, .8)* 
(.5, .4 + .1, 0)*, (0, .6 + .1, .3), (0, 0 + .2, .8) 
(.5. .4, 0 + .1) . (0, .6, .3 + .1)*.(0, a. 0.8 + .2)* 



In this case the extreme points, which are marked with an asterisk, are 
easily recognized by plotting them on the triangular plane of the region 
X as in Figure 1. In higher dimensions the recognition of extreme points 
is more difficult although algorithms are available. However, the mere 
inspection of the set of co-ordinates given by Theorem 2 gives an idea 
of the kind of structures which are attainable. 

Condition for Halnta inability 

This is easily derived as a special case of Theorem 1. If a point 
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(0, 1, 0) 



(0, .6, .4) 




(0, 0, '.) (.2, 0, .8) 



(1. 0, 0) 



The region A when k = 3 and P 




Figure 1 
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can be reached from itself then the system can remain there as long as 
desired. Let S denote the set of maintainable points, then we have 

THEOREM 3 

S = {x 1 X > xP, xeX) 

The recruitment vector required to hold the system dt a particular x 
is easily obtained from (1). • - 

THEOREM 4 

If xe5 then the system can be k ept at that point , hv choosing 

p = x(I - P)/L 
where L = xw', the proportion of leavers. 

This result leads to a more explicit description of the region S which 
is given in the following theorem. 

THEOREM 5 

The vertices of S have co-ordinates proportional to 

e,(I - P)-'^ (i - 1, 2, ... k) 

with the constant of proportionality bein;^ determined so that the elements 
sum to one . 

Proof ; From Theorem 4. 

X - xw'pd - P)"^ 

- "^J ih Pi!i<! - 

for all points xeS . Hence, any point in S can be written as a convex 
' ination of the points e^(I - P)"'^ multiplied by a scaling factor xw' 



to make the elements sum to one. The vertices of S thus have co- 
ordinates proportional to e^^Cl - P) ^ . | | 

COROLLARY 

If = w (i = 1, 2, . . . k) then the co-ordinates of the vertices 

are 

e^(I - P)"^ , (i - 1, 2, . • . k) • 

Proof 

The result follows at once on noting that, in this case xw* » 1 
for all X . 

THEOREM 6 

If x*eS then we can gat arbitrarily close to x* , no matter what 
our starting pbint, by adopting the recruitment policy 

p = x*(I - P)/x*w' for all T. 

Proof 

If we apply a recruitment policy which is constant over time we may 
write (2) in the form 

x(T + 1) - x(T)Q . 

Q is a regular stochastic matrix so that the system will have a limiting 
structure satisfying x - xQ . The limiting structure will therefore be 
X* if we can find a p such that 

X* • x*(P + w'p) with x*!' » 1 

This equation is satisfied if we choose p as given in the theorem. |^| 
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At this point it is convenient to identify the practical implica- 
tions of these theorems as listed below: 

(a) If our goal vector x* is in A it can never be attained 
by varying the appointment vector alone (Theorems 1 and 2) . 

(b) If our goal vector x* is in A - S it may be attainable 

but it will not be possible to remain at x* once it is attained (Theorem 
3). Whether or not we can remain sufficiently near to x* remains an 
open question. 

(c) If x*6:5 we can ultimately get as close as we please to x* , 
no matter where we start. Further we can reach the goal by using a con- 
stant appointment policy (Theorems 3, 4, 5 and 6). 

In the following section we shall investigate the best way of reaching x* 
given that it is (or may be) attainable. If our goal is not in 5 there 
are only two courses open to us. Either we must change the goal so that 
it can be reached or we must change the parameters of the problem. This 
amounts to resorting to methods (b) or (c) of Section 1. The means of 
doing this are provided by Theorems 3 and 4. We must adjust the elements 
of P , and by implication, the value of w so that x* lies within the 
new 5 . 

It may happen that the appointment vector needed to maintain the desire* 
structure is. itself unacceptable. For example, it may require that appoint- 
ments be made only at the lowest level, so preventing the recruitment of 
distinguished faculty at higher levels. In such an eventuality, it must 
be accepted that the two requirements are incompatible and that one of 
them, at least, must be relaxed. 

5. The Problem Deteminlng Optimal Appointntent Policies 

A successful appointment policy is one which achieves the desired 



goal. An optimal policy is one which does so in the most "satisfactory" 
way. It will help to clarify the attributes of an optimal policy if we 
first identify some of the characteristics of an unsatisfactory policy. 
We suggest that the following features are um .sirable in any appointment 
policy: 

(a) a large number of steps to reach the goal. 

(b) a series of abrupt changes from one time period to the next. 

(c) passing through some undesired structures on the way to the goal. 

(d) high cost (in terms of salaries, etc.) , 

The last point may simply be another aspect of (c) since high cost would 
make some structures undesirable. We shall proceed on the assumption that 
(a) is the most serious disadvantage and so try to devise strategies 
which attain the goal in a small number of steps. We shall use (b) and 
(c) as guides in choosing between strategies which take similar times 
to reach the goal. 

The mathematical problem which we shall try to solve is thus 
the following: To find the smallest T , denoted by T* , such that there 
exists a sequence of vectors {p(T)} with non-negative elements satisfying 

X* 

X* - x(0) {p + w'p(T)} (5) 

If the goal is attainable in a finite number of steps, T* can 
always be found, in principle, by direct computation. We would have to 
set T* « 1, 2, . . . in turn and determine at each stage whether 
or not the equations (5) had a solution in non-negative p(T)'s. The 
smallest value of T* for which this was true would be the one required. 
In practice this is a formidable task so we shall aim here to gain some 
insight into the nature of the solution by elementary mathematical analysis. 
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Our results are in the form of bounds cn T* which, in exceptional 
cases, may serve to determine its value. No computations have been made 
to investigate the closeness of thest bounds; this should have high 
priority in future work. The following theorems and their corollaries 
contain the main results. 

THEOREM 7 

T* > T' where T' is the smallest T for which 

Proof 

If we are to have 

T 

X* " x(0) P + w'p(j) 

for some T then the first term in the expansion of the product 

on the right hand side cannot exceed x* simce all the remaining terms 

are necessarily non-negative. | | 

~ • K 

It should be noted that x(0)P^ is the vector of the proportions of 

the original members of the system who remain at time T . Hence 

it is intuitively obvious that the goal cannot be reached until all of 

these have decreased below the target levels. The result of Theorem . 

7 is quite general but from this point onwards we shall have to make 

a further assumption in order to make progress. We shall assume that 

w^ « w for all i . This means that an individual's chance of leaving 

is the same no matter where he is in the hierarchy. In practice 

leaving rates tend to decrease as we move from the lower to the higher 

ranks. In spite of this restriction we may hope to gain some insight 

\ 



into the nature of the solution which will pave the way for further 
generalization. Atcei Theorem.. 8 we shall make the additional assumption 
that the promotion matrix P is upper triangular. There is no lack 
Of realism in this assumption since demotions rarely, if ever, occur. 

THEOREM 8 

T-1 

x(T) « x(0)f + w p(T - j)pJ 

Proof 

The proportion of leavers who have to be replaced at time T 
is x(T)w* = w because all the elements of w are equal to w . 
Hence, wp(T - j)P^ is the vector of the proportions of people 
recruited at time T - j who survive ^o time T . The expression 
on the right hand side in the statement of the theorem is thus the 
cumulative sum of all survivors, including those who were present 
at T « 0. Q 

The point of this theorem is that it shows that x(T) can be 
expressed as a linear function of the appointment vectors when the loss 
probabilities are equal. This represents a very considerable simplifi- 
cation which makes it possible to arrive at the following results, 
THEOREM 9 

T* £ T" where T" is the smallest value of T such that 

x*?"^"^ " ^ x(0)P > 0 

Proof 

The method of proof is to show that x* can be reached in T" 
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steps if the condition given holds. The smallest possible number of 
steps obviously cannot exceed T" . If the goal is reached after T 



steps then 

T-1 



X* = x(0)P^ + w p(T - j)P^ (by Theorem 8). 
Re-write this equation in the form 



T-1 , X* - x(0)P^ 

p(t - j)p^ = - — y • 



Then it may easily be verified that ^6) is satisfied by 



p(T - j) = yP'-'^ 



^(1 - for j ' 0 T . (7) 



1 - (1 - w)^ 



For this to be an admissible solution it is also necessary that all of 
the vectors p(T - j) should have non-negative elements summing to one. 
We first show that 

p(T - 3)1' = 1 where 1' is the vector (1, 1, . . D • 

Let u - yP"^ then u is the vector which when post-multiplied 
j times by P gives y . Since the loss rates are equal, each multi- 
plication by P reduces the total size by a factor (1 - w) . Therefore. 



ul' - (1 - w)'^ yl' 



But 



yl' - (x*l' - x(0)P^l')/w = {1 - (1 - w)'^}/w 
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Therefore, 



yl' = {1 - (1 - w)^}/w(l - w)- 



Substitution in (7) now yields the required result. 



The requirement that the elements should be non-negative is that 



yP"^ > 0 for j = 0, 1, 2, . . . T - 1 



which, substituting for y , may be written 



x*p"- - x(0)P^"^ > 0 , j = 0, 1, 2, . . . 



T - 1 . 



(8) 



Suppose that these inequalities are satisfied for J = then it 

follows that they are also satisfied for i = i - 1 since a vector of 

o 

non-negative elements multiplied by a matrix with non-negative elements 
yields another non-negative vector. Hence it is sufficient for (8) to be 
satisfied with j = T - 1 and this gives the condition of the theorem. | 

Note that condition (8) is always satisfied for j = 0 if T >^ T" (see 
Theorem 7). Further insight into the nature of the conditions can be 
obtained by writing out the first two elements in the vector inequality 



x*P"^^ ■ - x(0)P > 0 



These are 
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^Pii'' ' ' ^i^^^Pii i ° 



l(0>Pl2 - ''2^°^P22 i °J 



(9) 



22 



where 

[T-i] „ j-T+i 

•^12 " "Pl2 j^O Pll P22 

is the (1, 2)*^^ element in the (T-l)*^^ power of P"'''. The first 
inequality can obviously be satisfied by making T sufficiently large. 
However, the same is not true in general for the second inequality 
because x* and x* have coefficients of opposite sign and comparable 
magnitude* 

If a value of T" can be found then (7) gives a sequence of 
appointment vectors which will achieve the goal in X" steps. This 
may not be an optimum sequence but if X" is acceptably small the 
strategy is well worth considering. It is the only one we have for which 
the number of steps to reach the goal is known in advance but it relates 
only to the case of equal loss probabilities. 

The strategy implied by (?) has the following interpretation. 
7t requires us to choose p(X j) in such a way that the proportions 
of those recruited at time X - j who will remain at time X is pro- 
portional to y for all j . Xhe vector wy may be described as 
the "recruitment needs" at time X and so the strategy requires us to 
select appointment vectors in the light of what the recruitment needs 
will be at time X . 

Our remaining result is much more limited in its scope. Instead 
of trying to reach the goal in every grade we merely try to meet the 
goal in the lowest grade only. In this special case a complete solution 
can be achieved if P is upper triangular and w^ « w for all i . 



23 



THEOREM 10 



Let T* be the smallest number of steps in which the target 
can be reached in grade 1 , then T* is the smallest T for which 



''l ' Pll''l^°^ T 

w 1 a - Pii)/a - Pu> 



Proof From Theorem 8 



x^(T) - ?l^\(0) + wCp^'S^d) + pJiSi(2) + . . . + Pj^(T)} • 



We can only make x^(T) * x* if x* is between the minimum and the 
maximum of the right hand side of the equation. It is obvious that the 
minimum occurs wuen 



p^(l) « p^(2) = . . . « p^(T) = 0 



and the maximum when 



p^(l) - f^(2) = . . . = p^(T) » 1 



Hence, at least one solution in positive Pj^(j)'s exists if 



Pn^(o) < X* < ?l^x^(o) + w{pj^^ + pj^2 + _ , + 1} (10) 



which, is equivalent to the inequalities given in the statement of 



f the theorem. 



I Corollary 10.1 



I The goal in grade 1 can ultimately be reached if 

I 

^1 X* < max (w + P^^x^CO), w/(l - p^^)) 

ERICf 
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Proof 

Re-write (10) in the form 



p^^x^(O) < X* < w/(l - p^^) + Piitx^(O) - w/(l - p^^)} 

Then if Xj^(O) > w/(l - p^^) the upper limit is a decreasing function 
of T and so if the inequality is satisfied at all it is satisfied for 
1=1. This gives 

If Xj^(O) < w/(l - Pj^j^) the upper limit is a non-decreasing function 
cf T with maximum value, occurring in the limit as T on w/ (1 - p^^) 

In the limit, the. lower inequality is always satisfied and so the result 
follows. I i 

Corollary 10*2 

Theorem 10 provides a complete solution to the problem of finding 
T* when k = 2 and shows when a solution exists . (Triangular P and 
w^ = w for all i ) . 

The geometric form of the two limits of Corollary 10*2 shows 
that the limiting values will be attained quite rapidly for typical 
values of Pj^j^(0.6 - 0.7). This means that if the goal can be achieved 
at all it is likely to be reached quickly. 



Corollary 10.3 



T* >^ T* 



In this section we have defined an optimal policy as one which 
reaches the goal in the smallest number of steps. At the present 
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time it does not appear computationally feasible to determine the 
optimal policy in this sense in any but very special cases. Nevertheless, 
the theorems which we have given provide some information about the 
value of T* and hence provide a yardstick with whtch proposed policies 
may be compared. In the remainder of this report we shall be considering 
some strategies which seem intuitively reasonable. In our suggestions 
for further work in Section 7 we shall propose that they be evaluated 
in part by the criterion which forms the basis of this section. 

6. Strategies Which Look One Step Ahead 

We have seen that it is not possible, in general, to find strategies 
which will make the desired change of structure in the minimum number 
of steps. However, it is possible to devise strategies which have certain 
sub-optimal properties. In this and the following section we shall de- 
scribe some such strategies and investigate their performance. 

The first class of strategies is designed to get as near as possible 
to the goal in one step. In the short term this is an attractive property 
but it may have to be paid for in the later stages of the transition. For 
a system starting at x(0) we have to find a point x(l) which can be 
reached from x(0) and which is such that the distance from x(l) to 
X* is a minimum. Having reached x(l) so that then becomes the starting 
point for another step, and so on. There is, of course, no unique mea- 
sure of "distance" in this context, and different measures will lead to 
different strategies. A class of reasonable measures of the distance from 
x(l) to X* is given by 

k 

D - iil I x^* - x^(l) 1^ , a > 0 . 
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We shall investigate the case a - 1 and a - 2 . First we prove two 
theorems about all members of this class. 

THEOREM 11 

If X* can be reached in one step from x(0) then a strategy 
minimizing D will do this. 

Proof 

The result is obvious because if x* can be reached in one step 
there must exist at least one x(l) which makes D zero. 

THEOREM 12 

The vector p which minimizes D also minimizes 



k ^ 
D' = - P^l . a > 0 



where 



y = (x* - x(0)P)/x(0)w' 



Proof 

X* - x(l) = X* - x(0)(P + w'p) 

Q* - x(0)P 

x(0)w^^= ' ^ - P( 

x(0)w' 

= constant {y " 

Hence, any function of the differences x,* - x,(l) will be proportional 
to the same function of the differences " P^ • 1^1 

This theorem has an interesting interpretation. If we were to 
take p - y then it may easily be verified that the goal would be reached 



in one step. However, we cannot do this in general because the elements 
of y are not necessarily all positive. Theorem 12 leads us to choose 
an admissible p which in a certain sense is nearest to the inadmissible 
p which would have taken us to the goal in one step. 

It would be useful to know something about the conditions under 
which strategies minimizing D will reach or converge on x* . The 
following conjecture is supported by intuition and calculation but a 
satisfactory proof is lacking. 

CONJECTURE 

If S , strategies minimizing D will ensure that 

lim x(T) = X* . If x*^ S , x(T) will reach, or converge to the point 

in S nearest (in the sense of D ) to x* . 

The minimization of D subject to the restraints p > 0 and 

r 

?y =1 is a problem in mathematical programming which is discussed 
in the Appendix. When a = 1 it turns out that there is a whole class 
of strategies which will give the same value of D . It does not follow 
that, when applied repeatedly, every membfer of this class will produce 
the same trajectory because there are infinitely many steps which can be 
taken from x(0) which yield the same value of D . When a « 2 the 
solution is unique. It also minimizes D with a « 1 and the argument 
of the Appendix may easily be extended to show that it minimizes D for 
any even positive integer a > 2 . The strategies which we have selected 
to examine in detail are the following. 

The Strategy 

This is one of those which minimizes D with a * 1 . It is defined 
as follows. 'Compute y and replace all negative elements by zero. Re- 
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scale the remainder so that their sum is 1 . This strategy is thus one 
in which we allocate to each grade which is below strength an equal pro- 
portion of their needs. 

The Strategy 

This is the strategy obtained by minimizing D with a - 2 . It 
may be compared iteratively as follows. Compute 

y^' =0 if y^ < 0 

y.' = y, - - - 1} if y > 0 
■'i ■'1 m i — 

where m is the number of non-negative y's and Y is their sum. If 

y' > 0 then p = y' , otherwise treat the y^' s as original s 

and repeat the cycle as often as necessary to produce a positive vector. 

The Strategy 

In each time period a proportion x(T)w' of members leave the 

system. An equal number of replacements are allocated to the various 

grades according to the chosen p . With this strategy we select 

max y. and if max y^ i 1 . all of the recruits go into that grade, 
i 

If max y^ < 1 , we bring the number in this grade up to its target 
by allocating a proportion max y^ to this grade. We then move off 
to the grade showing the next largest shortfall and treat that in the 
same way. This procedure is continued until all of the recruits have 

been dealt with. 

It is easy to see that S3 also minimizes D with a - 1 and 
hence will reach the goal in one step if that is possible. 



29 

The Strategy 

Here we put all recruits into the grade having the largest . 
In general, this does not seem a very desirable policy since it might 
involve appointing all assistant professors in one year followed by 
all full professors the next. Nevertheless it is useful to include 
it for purposes of comparison with the other strategies. 

The final strategy which we shall consider was specifically 
designed to ensure a smooth transition from x(0) to x* . We restrict 
our attention to points x(T) satisfying 

x(T + 1) = ax* + (1 - a) x(T), 0 <0L <1, T >^0 . (11) 

The trajectory for such a policy is thus a straight line joining the two 
points x(0) and x* • Substituting (11) in the basic equation 

ax* + (1 - a)x(T) = x(T)(p + w*p(T + 1)) 

Solving this equation for p(T + 1) we find 

p(T + 1) » (ax* + (1 - a)x(T) - x(T)p]/x(T)w* . (X2) 

The formal analysis just carried out may not yield a non-negative p 
for any a . In this case no progress will be possible and the strategy 
must be abandoned. Otherwise is defined as follows. 

The Strategy. 

Select the largest value of a(0 £ Ct £ 1) for which p(T + 1) 
as given by (12) is non-negative. 

This strategy thus moves as far as possible in the direction of 
X* at each step. Like S , and 5^ (but unlike $/) it will 
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therefore reach x* in one step if that is possible. In practice 
we have rarely found it possible to make any progress at all with this 
strategy. When it can be used it is either equivalent to or no better 
than one of the other strategies. For this reason it only appears in 
one of the tables. 

An obvious strategy if x* £ S is the one suggested by Theorem 
6 which uses a constant appointment vector given by 

p = x*(I - P)/x*w' 

Although this strategy does not appear in our calculations we shall 
be able to compare it with the others in certain cases. 

Tables 1-5 summarize the results of calculations made using the 
strategies 5j^-5^ for two promotion matrixes of dimension 3 and 5 . 
The calculations may not be fully representative and the conclusions 
set out below must be interpreted with this remark in mind. We shall deal 
with the tables one by one but the following remarks apply to them all. 

(a) and S, are almost identical for these examples. 
3 4 

(b) S2 tends to spread the recxuits more widely. over the 
grades than does but otherwise the strategies are 
similar. 

(c) The goal is reached within 10 steps on only one occasion 
but when k = 3 the structure is often very close to the 
goal after 5 steps. Rather more steps seem to be needed 
when k « 5 . 

Table 1 

The goal here is the vertex of S which would be reached, in 
j^l^Q' the limit, by using the constant appointment vector p « (10 0). 
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The strategies and starting from (0 1 0) turn out to be 

identical with this constant strategy. In the case of the starts from 
(1 0 0) and (0 0 1) the sequence p(T) becomes equal or very close 
to this in every case as the structure approaches the goal. In this 
example, all of the strategies produce a structure close to that 
required im a very few steps. 

Table 2 

Here the goal is outside S and all strategies appear to be 
converging on a point at or near the vertex used as the goal for Table 
1. None of the strategies takes us very near to the goal but all get 
near to their limiting structure quite quickly. There are interesting 
differences between the sequences of appointment vectors in this case. 
Again,' they appear to be converging to a limit. 

Table 3 

The starting points in this table are not the five extreme 
points of X but three structures chosen to represent the spectrum 
of possibilities. As when k « 3 there is little difference between 
the strategies except now it is taking much longer to get close to 
the goal. This is particularly true of the example in the first 
section of the table. , , and are either near or equal to the 

pure strategy (10 0 0 0) throughout or quickly converge to it but 
allows a much greater spread. 

Table 4 

This is our only example in which the goal is exactly attained. 
Only and $2 are successful but it would be premature on such 

limited evidence to conclude that they will always show this super- 
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iorlty. The goal cannot be maintained and beyond T - 4 there seems 
little tu choose between the strategies. This is a case where a sequence 
of pure strategies would obviously be unsuccessful, in the early 
stages at least. 

Table 5 • 

This table is included to show a case where none of the strategies 
is very successful. The two illustrated are never near to the goal in 
every grade and matters are getting worse rather than better beyond 
T = 5. 
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TABLE lb: SEQUENCES OF APPOINTMENT VECTORS USED TO 
ACHIEVE HE RESULTS OF TABLE la 



Appointment Vectors for start at (1 0 0) 





0 


.135 


.717 


1 


1 


.970 


.970 


.976 


.981 


.985 




0 


0 


0 


0 


0 


.030 


.030 


.024 


.019 


.015 




1 


.865 


.238 


0 


0 


0 


0 


0 


0 


0 




, 0 


0 


.928 


1 


1 


1 


1 


.995 


.996 


.998 




1 0 


0 


0 


0 


0 


0 


0 


.005 


.004 


.002 




1 1 


1 


.072 


0 


0 


0 


0 


0 


0 


0 



^3 J „ n n . . . . 0 



0 0 1 

, . 0 0 0 
and 

S/ I 1 1 0 



Appointment Vectors for start at (0 1 0) 



0 



.690 


1 


1 


.921 


.908 


.925 


.941 


.953 


.963 


.970 


0 


0 


0 


.099 


.092 


.075 


.059 


.047 


.037 


.030 


.310 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


1 


1 


.986 


.973 


.983 


.989 


.993 


.995 


.995 


0 


0 


0 


.014 


.027 


.017 


.011 


.007 


.005 


.005 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 



TABLE lb (Continued) 
Appointanent Vectors for start at (0 0 1) 



.500 


.559 


.641 


.719 


.782 


.831 


.868 


.896 


.918 


.935 


.500 


.441 


.359 


.281 


.218 


.169 


.132 


.104 


.082 


.005 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


.500 


.639 


.747 


.827 


.883 


.922 


.949 


.966 


.978 


.986 


.500 


.361 


.253 


.173 


.117 


.078 


.051 


.034 


.022 


.014 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 



0 


1 


1 


.956 


.940 


.969 


.984 


.992 


.996 




1 


0 


0 


.024 


.060 


.031 


.016 


.008 


.004 


.002 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 



1 

0 
0 



0 

1 

0 



1 

0 
0 



1 

0 
0 



Note: At T - 1 x* - Xj^(O) - x* - X2(0) - 0.286 when starting from 
(0 0 1) . treated grade 1 a8~liavlng the largest differ- 

ence and chose grade 2 . This also accounts for the big 

difference between the and 5^ rows in the (0 0 1) part 

of Table la for T » 2 . 
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TABLE 2b: SEQUENCES OF APPOINTMENT VECTORS USED TO 
ACHIEVE THE RESULTS OF TABLE 2a 



Appointment Vectors for start at (1 0 0) 










0 


.143 


.558 


.801 .883 


.875 .860 


.853 


.852 


.851 


S 

1 


0 


0 


0 


0 0 


0 0 


0 


0 


0 




1 


.857 


.442 


.199 .117 


.125 .140 


.147 


.148 


.149 




0 


0 


.710 


.975 .935 


.919 .913 


.911 


.910 


.909 




0 


0 


0 


0 0 


0 0 


0 


0 


0 




1 


1 


.290 




. uox . uo / 


.089 


.090 


.091 


^3 


0 


0 


1 


* • 




* 


• 


1 


and 
S 


0 


0 


0 






• 


• 


0 


4 


1 


1 


0 


• • 




* 


* 


0 


Appointment Vectors 


for start 


at (0 1 0) 










.600 


.849 


.970 


.925 .872 


.855 .851 


.851 


.851 


.851 




0 


0 


0 


0 0 


0 0 


0 


0 


0 




.400 


.151 


.030 


.075 .128 


.145 .149 


.149 


.149 


.149 




f 1 


1 


1 


.989 .918 


.913 .910 


.910 


.909 


.909 


^2 


0 


0 


0 


0 0 


0 0 


0 


0 


0 




0 


0 


0 


.011 .082 


.087 .090 


.090 


.091 


.091 
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TABLE 2b (Continued) 



Appointment Vectors for start at (0 0 1) 

1.600 .698 .814 -dU .SM .133 .SU ,U% .951 .«51 

.400 .302 .146 0 0 0 0 0 0 0 

0 0 0 0 .127 .167 .158 .152 .149 .149 



.750 .819 .957 
.250 .181 .043 
0 0 0 



1 .890 .893 .903 .907 .908 .909 
0 0 0 0 0 0 0 

0 .110 .107 .097 .093 .092 .091 



1 
0 
0 



1 .976 1 
0 .024 0 
0 0 0 



1 
0 
0 




ERIC 



Tables 3 , 4 and 5 relate to a system with the following paraaetars 



P = 



.65 
0 
0 
0 
0 



.20 0 

.70 .15 

0 .75 

0 0 

0 0 



0 0 
0 0 
.15 0 

.85 .10 

0 .95 



w = (.15 .15 .10 .05 .05) 



A point is in S if 

X2 > (2/3)Xj^ , > (3/5)x2 i X3 . X5 i 2x^ 



The goal in Table 3 is obtained by taking the equality sign in each 

case. This gives the structure with the greatest degree of "tapering" 

towards the top which can be maintained. The other goals in Tables 
'* an 

4 and 5 lie outside S . 
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TABLE 3b: THE SEQUENCES OF APPOINTMENT VECTORS 
LEADING TO THE STRUCTURES GIVEN IN TABLE 3a 



Appointment Vectors starting at (.05 .10 .15 .30 .40) 





1 Pi 


.668 


.665 


.654 


.655 


.663 


.674 


.687 


.700 


.713 


.725 


^1 


P2 


.312 


.305 


.289 


.274 


.261 


.250 


.240 


.231 


.223 


.216 




^3 


0 


.030 


.057 


.071 


.076 


.076 


.019 


.06* 


.064 


.059 


^2 


Pi 
^2 


1 
0 


1 
0 


1 
0 


1 
0 


.989 
.011 


.984 
.016 


.989 
.011 


.992 
.008 


.994 
.006 


.996 
.004 


^3 

and : 


Pi 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1« 


Appointment Vectors starting at (.2 


.2 .2 


.2 .2) 












' Pi 


.749 


.808 


.848 


.855 


.864 


.873 


.882 


.889 


.896 


.898 




P2 


.102 


.up 


.152 


.145 


.136 


.127 


.118 


.111 


.ft04 


.099 


1 


P3 


0 


0 


0 


0 


0 


0 


0 


0 


0 


.005 




P5 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




Pi 
P2 


1 
0 


1 
0 


1 
0 


1 
0 


.995 
.005 


.992 

.008 


.994 
.006 


.996 
.004 


.997 
.003 


.998 
.002 


and : 
^4 


Pi 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 
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TABLE 3b (Continued) 



Appointment Vectors starting at (.40 .30 .15 .10 .05) 



.186 .580 .792 .914 .954 .942 .941 .945 .949 .953 

0 0 0 0 .025 .058 .059 .055 .051 .047 

.060 .044 00000000 

.754 .416 .208 .086 .022 0 0 0 00 0 



0 .849 .927 .949 .966 .978 .987 .993 .997 1 

1 .151 .073 .051 .034 .022 .013 .007 .003 0 



3 
and 



• 



TABLE 4a: AN EXAMPLE IN WHICH THE GOAL IS ACHIEVED 
AT T = 4 BY AND WHERE THE GOAL IS NOT MAINTAINABLE 



A3 



Start 



.2 



.085 
.085 

.085 
.140 



.152 
.152 

.152 
.160 



.162 
.162 

.162 
.180 



.261 
.251 

.287 
,240 



.340 
.351 

.315 
.280 



.048 


.098 


.148 


.297 


.410 


.048 


.098 


.148 


.298 


.410 


.029 


.101 


.151 


.301 


.417 


.023 


.075 


.179 


.295 


.427 


.052 


.101 


.151 


.299 


.397 



10 



Goal 



.041 


.088 


.136 


.286 


.449 


.038 


.088 


.138 


.288 


.450 


.021 


.100 


.148 


.276 


.455 


.031 


.121 


.130 


.254 


.464 



.05 



.Cannot proceed beyond 1^5. 



.10 



.15 



.30 



.40 
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TABLE 4b: THE SEQUENCES OF APPOINTMENT VECTORS 
LEADING TO THE STRUCTURES GIVEN IN TABLE 4a 





Pi 


0 


0 


0 


.190* 


.212 


.207 


.203 


.199 


.195 


.192 




P2 


0 


0 


0 


.036 


.242 


.243 


.243 


.243 


.243 


.242 


^1 




P3 


U 


0 


.052 


. lX3l 




.273 


.274 


.274 


.275 


.275 




P4 




.391 


.4S4»'- 


• 437 


• 2/ J 


• 277 


• 2S1 


• 2M 


•2lt 






P5 




.609 


.462 


• UDU 


u 


U 


u 


U 


u 


U 




Pi 


0 


0 


0 


.191* 


.207 


.199 


.192 


.185 


.179 


.172 




P2 


0 


0 


0 


.036 


.241 


.243 


.244 


.245 


.246 


.247 


h 


. P3 


u 


0 


0 




• Z/0 






.280 


.2ol 


.2o3 




P4 


• U3U 


.550 


.628 




• Z/0 




• 2oO 


. 290 


10/. 
.294 


.29o 




P5 


• 73U 


.45»50.372 


no A 


U 


U 


U 


U 


U 


U 




Pi 


0 


0 


0 


.123 


0 


.439 


0 


.417 


0 


0 




P2 


0 


0 


0 


0 


.335 


.331 


.060 


.498 


0 


.549 


h 


> 


P3 


0 


0 


0 


.310 


.335 


.230 


.366 


.085 


.378 


.451 




P4 


0 


1 


.113 


.566 


.329 


0 


.574 


0 


.622 


0 




J P5 


1 


0 


.887 


0 


0 


0 


0 


0 


0 


:0 




Pi 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 




P2 


0 


0 


0 


0 


0 


1 


0 


0 


0 


1 


h 


■ P3 


0 


0 


0 


0 


1 


0 


0 


0 


1 


0 




' P4 


0 


1 


0 


1 


0 


0 


1 


0 


0 


0 




P5 


1 


0 


1 


0 


0 


0 


0 


0 


0 


0 






.400 


.313 


.215 


.102 


0 












1 

^5 


1 P2 
■ P3 
P4 


0 
.100 
.200 


0 

.111 
.259 


0 

.124 
.325 


0 

.138 
.401 


.017 
.162 
.470 




Strategy 
Terminates at 








P5 


.300 


.316 


.336 


.359 


.351 






T - 5 







* Indicates the point at which the goal is achieved 
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TABLE 5a: TWO EXAMPLES WHERE AND ARE UNSUCCESSFUL 
IN REACHING THE GOAL 
In both cases the goal is outside S 







1 


2 


3 


4 


5 


X 

1 


2 


3 




*5 


T 


Start 


.2 


.2 


.2 


.2 


.2 


.2 


.2 


.2 


.2 


.2 


2 




.200 


.217 


.167 


.197 


.220 


.085 


.152 


.283 


.258 


.223 






.250 


.172 


.162 


.197 


.220 


.085 


.152 


.322 


.222 


.220 






.203 


.224 


.148 


.182 


.243 


.034 


.111 


.293 


.292 


.269 


5 




























.276 


.176 


.128 


.178 


.243 


.023 


.097 


.347 


.275 


.258 




^1 


.203 


.225 


.144 


.161 


.266 


.024 


.088 


.255 


.291 


.341 


10 




.290 


.190 


.114 


.145 


.261 


.003 




.306 


.304 


.331 




Goal 


.40 


.30 


.15 


.10 


.05 


.05 


.15 


.40 


.30 


.10 
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TABLE 5b: THE SEQUENCES OF APPOINTMENT VECTORS 
LEADING TO THE STRUCTURES GIVEN IN TABLE 5a 



Appointment Vectors when the Goal Is (.40 .30 .15 .10 .05) 



.692 .706 .714 .718 .715 .712 .711 .710 .710 .710 
.308 .294 .286 .282 .276 .273 .271 .270 .269 .269 
0 0 0 0 .009 .015 .018 .020 .021 .021 



1111 .985 .987 .990 .991 .992 .993 
0 0 0 0 .015 .013 .010 .009 .008 .007 



Appointment Vectors wh«n the Goal Is (.05 .15 .40 . lO .10) 



0. 0 0 .060 .094 .105 .109 .109 .107 .106 

0 0 .116 .192 .230 .248 .255 .258 .258 .257 

.688 .738 .719 .661 .631 .619 .612 .608 .604 .601 

.313 .262 .165 .086 .045 .029 .024 .026 .030 .047 



P3 
P4 



0 0 0 .OSl .203 .200 .191 .179 .165 .150 

1 .895 .905 .909 .797 .800 .809 .821 .835 .850 
0 .105 .095 0 0 0 0 0 0 0 



7. Strategies Which Look Two Steps Ahead 

Although the strategies investigated so far perform reasonably 
well we might hope to improve upon them by looking farther ahead. 
We shall therefore suggest two further classes of strategies which take 
into account what the position will be after the next step has been taken* 

The Class of Strategi es 

This class is a natural extension of that which gave rise to 
Sj^ and $2 • Instead of seeking to minimize, at the start, the distance 
between x(l) and x*, we now consider the distance between x(2) and x 
The problem is then one of minimizing a function such as 

k 

i£l IV ^(2)1^ , a> 0 
with respect to p(l) and p(2) subject to the usual restraints . 

The Class of Strategies S" 

Here the object i^ to aim initially n«t for x* itself but for 
some other point from which x* can be reached in one step. The moti- 
v«tioQ for this is that there may ell be points from which x* is 
reachable in one step which are much more reasonable than x* • Let ^ 
X^^ denote the set* of points from which x* can be reached in one step; 
then the following would be a possible way to proceed. At time T use 
one of the strategies ^^'^^ to aim for the point in X* nearest 
to x(T) r If this point can be reached then x* can be reached in 
One further step. 

Other classes of strategies can easily be devised by extension of 
these ideas but it would be better to explore th'^ -a already proposed 



A8 



before proceeding further. 

8, Suggestions for Further Work 

The work described in this report is incomplete at almost every 
point. Below we list some of the topics on which further work is needed 
if the control problem is to be fully understood. 

(a) Throughout we have assumed that the total size of the 
organization was fixed. The theory needs to be developed 
for organizations whose size is changing in time. 

(b) The class of strategies S' and 5" require further 
investigation. A comparison between the original class 

S and S' or would throw some light on whether it is 

worthwhile to look beyond the next step when choosing p . 

(c) The question of how one can stay near to x* when x* 
is outside S needs further investigation. It is known 
that a trajectory can move outside 5 infinitely often but 
it is not clear whether it is possible to pursue a path which 
is ''nearer" to x* than the nearest point on the boundary of 
S. 

(d) " Tfie'strategies should be tried out using data for the larger 

colleges on the various campuses. 

9. Implications for Policy 

The work described in this report is a step towards a general 
theory of control for Markov chain models of graded manpower systems. 
As such it is primarily a theoretical exercise intended to give some 
insight into the dynamics of such systems. It was, however, motivated 



by the problem facing a university whose faculty structure was moving 
in an unwanted direction and there are several conclusions which can 
be drawn which have important implications for those faced with that 
problem. For any organization, in which the assumptions of the 'model 
apply, the following conclusions hold. 

(a) Not all structures are attainable or maintainable by control** 
ling the appointment policy alone. Those which are can be 
found from results given in this report. Those which are not 
can only be reached by making changes in the promotion rates 

or by contriving to alter the leaving rate* The kind of changes 
needed can also be determined from the results given here« 

(b) Some changes in structure can be brought about by appropriate 
variations J.n the appointment * policy . The best way to do 
this is still an open question but several strategies have 
been proposed which seem to give satisfactory results. Of 
these strategy described in Section 5 is both easy to 
determine and satisfactory in its performance. 
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APPENDIX 



The implementation of the strategies and requires the 

minimization of 



k 

for a » 1 and 2 where p, ^ 0 (i « 1, 2, . . .k) and Z p » 1 . 

i»l ^ 

We show here how the results given in the text may be justified 
taking first the case a » 1 . 

The problem of minimizing D when a « 1 can be converted 
into a problem in linear programming by a well known device as follows. 
Transform to new variables x.^ and x.*" given by 



k 




a 



Xi"" - Yi - Pi if 1 Pi 



■ 0 otherwise > 



» 0 otherwise. 



It follows that 




and so the function to be minimized is 
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D - r (x Z + X ") 

i-l ^ ^ 
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The restriction 



k 

E p = 1 
i=l 



becomes 
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i=l ^ i=l 



and the inequalities 1 0 become 

x^"*" < for those i for which i 0 

^~ > -y^ for those i for which < 0 . 

Introduce slack variables > 0 such that = "^i " ^i 

and let and Z~ denote summation with respect to 

i over those values for which y. > 0 and y^ < 0 respectively. 

Then eliminating Ex^"^ from D using (Al) and substituting 

X." = - y^ we have 



D - -2J:'*'y^ + 2E'''v^ + 2 "x^- 



This clearly achieves a minimum value of -21 y^ when - -y^ 

if y^ < 0 . This implies p^ = 0 if y^ < 0 . The complete 
solution can easily be found by revetting to the original notation 
for now we have ro find p^ 's (for t 0> "^ich make 



It is clear that air^ set of p's satisfying >^ will yi«ld 
this miniinum value. In particular the p's adopted for and for 



When a = 2 the problem can be interpreted geometrically. 
D can be thought of as the squarti distance from y to the point p 
It must lie on the hyperplane Pj^ + Pj + • • • Pj^ « 1 in the orthant 
p >^ 0 ; call this region P . The vector y lies on the same 
hyperj^iane but not, in general, in the positive orthant. The problem 
is thus one of finding the nearest point in P to the given point 
y . Let 



where a is an undetermined multiplier. Then we have to find the 
minimum of (j> subject to P >^ 0 • Denote the minimizing value of 
p by p' then at this point 




* - 2 (y. - p.) + 2a Z p, 
i«l ^ ^ i-1 ^ 




« 0 if p ' > 0 




« 0 



which implies 



» 0 



- a 



if > a 
if < a 
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for some a which will be a function of the y's . The multiplier . 
O is determined by the condition 

k 

E p = 1 
i=l 

The iterative procedure described in Section 5 is one way of finding p^' 
and is will suited to automatic computation. A simple method with 
pencil and paper is to plot 



I < y. - a> 
i=l 



where 

<x> = X if X >^ 0 
= 0 otherwise 

as a function of a , finding the point at which the sum is one. This 
gives the value of a to substitute in 



Pi' = ^i - " 
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